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Abstract 

This paper is concerned with the Dynamic Programming Principle 
(DPP in short) with SDEs on Riemannian manifolds. Moreover, through 
the DPP, we conclude that the cost function is the unique viscosity solution 
to the related PDEs on manifolds. 
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1 Introduction 

El Karoui, Peng and Quenez [3] gave the formulation of recursive utilities and 
their properties from the BSDE point of view. As we know, the recursive opti- 
mal control problem is represented as a kind of optimal control problem whose 
cost functional is described by the solution of BSDE. In 1992, Peng [5] got the 
Bellman's dynamic programming principle for this kind of problem and proved 
that the value function is a viscosity solution of one kind of quasi-linear second- 
order partial differential equation (PDE in short) which is the well-known as 
Hamilton- Jacob i-Bellman (H-J-B in short) equation. Later in 1997, he virtually 
generalized these results to a much more general situation, under Markvian and 
even Non-Markvian framework ([6], Chapter 2). 
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But sometimes, in financial market, as the solution to a SDE with control, 
the wealth process of the investor may be constrained, for example, it should 
be nonnegative. In particular, for some special need, it may be a process in 
some curving spaces. So it is natural to consider the following question: if the 
SDE in stochastic recursive optimal control problems is defined on Riemannian 
manifolds, then will we still have the similar results as what we have mentioned 
in i?*^? The objective of this paper is to study this problem. 

Let {W{t),t > 0) be a (i-dimensional standard Brownian motion on some 
complete probability space J^, P). We denote by {J^t)t>o the natural filtration 
generated by W and augmented by the P-null sets of J-". 

Let [/ be a compact subset of i?*^"*"^. We call a function f : Q x [t,T] ~^ U a.n 
admissible control if it's an adapted stochastic process. We denote by Ut^r the 
set of all admissible controls. 

Assume that M is a compact Riemmannian manifold without boundary. Now 
we can consider the following controlled stochastic differential equation on M in 
a fixed time interval [t, T]: 

d 

dX'/-'^- = vo{s)Vo{s, X'/-'^-)ds + V X'/-'^-) o v^{s)dW:, 

ti (1.1) 

xl''^'"- = C e M, 

where C is J^rHieasurable, f. = t'(-) := {vq{-),vi{-), ...,Vd{-)) G Wj^t, and Vq, Vi, ...V^ 
are d + 1 deterministic one-parameter smooth vector fields on M. 

Since M is compact and without boundary, according to [4], there exists a 
unique M- valued continuous process which solves equation (1.1). Moreover, this 
solution does not explode. 

Let us consider functions / : [0,T]x M x Rx R^'^'^ xU R and $ : M i? 
which satisfy: 

(Al). there exists a constant X > 0, s.t., we have: ^t,\/{x,y, z,v) and {x' ,y' , z' ,v'), 
mx)-<l>{x')\ + \f{t, X, y, z, v)-f{t, x', y', z' , v')\ < K{\y-y'\ + \z-z'\+d{x, x') + \v-v'\), 

(A2). there exists a constant Kq > 0, s.t., \/{t,x,v), \ f{t,x,0,0,v)\ < Kq, 
where d{-, ■) denotes the Riemannian distance function on M. 

By the above assumptions, according to [6], there exists a unique solution 
(F., Z.) eM{t,T;Rx R^""^) to the following BSDE: 

r -rfy/.O- = /(s,X*'f^-,F5^-,Z*'C;-,t;,) - Zl''^-'--dWs,se [t,T], 
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where Ai{0,T; K^) denotes the Hilbert space of adapted stochastic processes 
f : n X [0,T] ^ R"" such that 

\\f\\ = {E r imi'dty^ < oo. 

Jo 

When C = a; G M is deterministic, We define 

J(t,x;z;(-)):=n*'"^"|.=t. 

This is the so-called cost function. And then we can define a value function of 
the optimal control problem as follows: 

u{t, x) := essinf^(.)gi^^ y J(t, x; v{-)). 

Our purpose is to get the general Dynamic Programming Principle of the 
value function u{t,x). 



2 Dynamic Programming Principle 

If we define 

^It '■= {'^(■) ^ ^t,T ■ v{-) is J^l - adapted}, 
where J"* := a{Wr - Wt, t < r < s}. 

By Proposition 5.1 in [6], there exist {v''{-)}°Zi, G W/^-, such that u(t, x) = 
limj_j,oo J{t, X] and u(t, x) is a deterministic function, i.e., 

u{t,x) := essmf^(^.)^u^^J{t,x;v{-)) = inf J{t,x;v{-)). 

Since our SDE is defined on Riemannian manifolds, V(C,f(-)) (C'l'^^'l'))) 
(P{Xl''''^- , Xl''^ ■) is not necessarily twice differentiable. So the good estimate 
about the continuous dependence of X.^'''''"- w.r.t to (C?'^^-) does not hold and 
nor does Y^'''''"-\s=f They're unfavourable factors for our dynamic programming 
principle. So we turn to the embedding mapping. 

By the Whitney's theorem, there exists an embedding mapping \l/ such that, 
^ : M ^ ^(M) C i?" for some n G iV. Set ^(X.*'^'''-) = X^^'""-, where C = ^(C)- 
Then X}'^'''- satisfies the following SDE on ^'(M): 

d 

< a=l (2.1) 

^xl'^-'^- = Ce^iM), 
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where Va = \1/*Vq,q; = 0,1,..., d and is the tangent mapping. And we can 
extend each Va to smooth vector field defined on i?" with compact support. We 
denote the extensions still by Va. 

So we have the following SDE in i?" whose initial point is in \1/(M): 

d 1 
a=l a=l 

(2.2) 

where V is the connection of i?". According to [4], SDE (2.2) has the same unique 
solution with SDE (2.1), i.e., although although SDE (2.2) is defined in K^, as 
long as its initial point is in \&(M), it won't leave \1/(M). 

Since U is compact and each is a smooth vector field in i?" with compact 
support, the coefficients of SDE (2.2) are bounded and Lipschitz continuous w.r.t. 
X and V. By [6], we have the following estimate: 

sup - X'/'-'^'f] < cue - Cf + E^^ r \vis) - v\s)\'ds), (2.3) 

where C > is a constant which only depends on the Lipschitz constant of the 
coefficients of SDE (2.2). Here and in the sequel, the constant C appearing in 
each estimate won't be necessarily the same one. 

Lemma 2.1. Y^'^''"' is continuous w.r.t (x, v{-)) and it is uniformly continuous 
in X, uniformly in {t,v{-)). 

Proof: Using Ito's formula to e^^'^~'^'^\Y^'^''"^ — Y^'^''^'-]"^ for some positive con- 
stant /3, we have 

= e^(^-*)E-^'|$(X^"'") - <I>(X^"''"')|2 + E^^ g/3(s-t)2(y^t,x;- _ y'/-^^' 



* 



{f{s, Xl'^-'^-, F^*--;-, z*'-;-, y^) - f(s, X'/ ''''' ,Ys' Z'/-'""' ,vi))ds 



< Ke^^^-''>E^^d\X'/'''-,X'/'''') + \E^^ e^{s-t)\zl>x;v. _ zy-'^^'l^ds 



"^'-'^Iv.-v'J^ds 



+E^' e'^'^'-'U\Xl''''''-,X'/'"')ds + E^' 
+E^* jT e^("-*)(2i^ + 2K^ + K^ + A^2)|y^*.^;^- _ Y^'''''''''\^ds. 
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If we choose (3 = 2K + AK'^ + 1, we have 

+E^' [ sup cf{X'/'''-,X'/'^')ds + E^' [ \vs-v'fds}. 
Jt se[t,T] Jt 

(2.4) 

Since M is compact, ^ : M ^ ^(M) and : ^(M) M are both 
uniformly continuous mappings. So with (2.3), when {x',v') — )■ (x,w), we have 



E^'[ sup d2(x*'-'-,X*'"'''''-)] ^ 0. 

sG[t,T] 



Moreover, when x' ^ x. 



sup sup '-,X*'"''"-)] < ^"''"(■'^"*^^-^*[ sup '"■)] -> 0. 

v{-)eUtT se[t,T] se[t,T] 

(2.5) 

Through the theorem of control convergence, we have that is continuous 

w.r.t (x, v{-)). 

What's more, Ve > 0, we choose 6o = -^t^j^- By (2.5), for this Sq, there exists 
6 > 0, such that, when d{x, x') < 6 (here 5 doesn't depend on x or x'), 

sup E^'[ sup (i2(x*'^'^-,X*'^>-)] < <^o- 

v{-)eUt,T sG[t,T] 

Combining (2.4), we have 

< C5o + CTSo = e. 

So we have finished the proof. 

□ 

And we can get some properties of u{t,x): 

Lemma 2.2. u{t,x) is bounded and uniformly continuous in x, uniformly in 

t. 

Proof: Applying Ito's formula to e'5i('*-*)|F/'^;^f (/3i = 2K + 2K^ + 2), with 
the same method of above, we have 

|y/'"'"|2 + E^^ /3ie^i(^-*)|y/'";^'i2ds + E^^ y"''e^i('^-*)|Z*'"'''f 

< e^i(^-*)E-^*|$(X^"'"-)| 

rT 

+E^' g/3i(s-j)2|yM;-|(^|y^t,-;-| + + |/(s, X*'"'''-, 0, 0, i;,) |)(is. 



Since $(■) is continuous and M is compact, is bounded. This with A2, we 
have that there exists some constant C independent of such that, 

|F/'^'^f + E^' j\^'^'-'^\Yl''''''fds + ]^E^' j|"^e^^(^-*)|Z*'^'^f (is < C. (2.6) 
So u{t, x) < C. 

By the definition of x), we know that for any e > 0, there exist v{-),v'{-) G 
UIj.^ such that, 

y/.-;- _ e < y/'"''"'- - e < u{t,x'). 

So we have 

y/'"'"- - £ < x) < y/'"''''-, y/'"'''''- - e < u{t, x') < y/-"''". 

And that yields 

Since y^*'^'^' is continuous in x uniformly in (t, we've got our conclusion. 

□ 

If we replace the variable x in u{t, x) by a r.v. C which is J-t-measurable, we 
have: 

Lemma 2.3. For any fixed t G [0,T] and C which is J-'^-measurable, we have: 

(i) Vi;(-)GWi,T,^i(t,C)<>^/'^^", 

(ii) V£ > 0, there exists a v{-) G Wt,T such that u{t, () > Y^'''"^' — e. 

Proof: We have known that u is continuous in x and y^'^'""' is continuous in 
Recall that the collection of processes (w (s))s6[t,T] with 

N 

{f(s) = ^^/Ait>*(s) : {Aj}^]^ is a J^^— partition of r2,t>*(-) G Wt^r is J-"*— adapted} 

i=\ 

is dense in W^ ^- So for (i), we need only to discuss special C and ?;(■) as follows: 

N N 
i=l i=l 

where Ai and are described as above, and xi G M, z = 1, A^. Then we can 
use the same method with Theorem 4.7 in [6] to get 

N N N 

i=l i=l i=l 
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For (ii), we can use the same technique. Considering that M is compact, for 
any n G N, there exist a collection of data {f/j, (/Jj}^"^ such that dim(t/j) < 
where dim([/j) := sup^ ^g^/ d{x, y). For any ( which is J^j-measurable, choose any 
fixed Ui e Ui and set rfn = Y.^=i yJ{u>:((ui)eu^}- Then we have 

By Lemma 2.1. and 2.2., for any e > 0, there exists 5 > 0, such that, when 
d{x, x') < 6, 

u{t,x)-u{t,x')>-'-, y/.-;'^_y/.->>_£, for any (t, G [0, T] x W,^. 

For this 5, through the discussion above, there exists rj = XilA, where G 
M and {Ajj^Jj^ is a J-^ — partition of f2, such that ^(r^, C) < 5, P — a.s.. So we 
have, for any (t,t>(-)) G [0,T] x Ut^x, 

u{t,0>u{t,v)-'-, y/'^^''-y/'^^''>-|,P-a.... (2.7) 
On the other hand, there exists G Ut^r, such that, 

n(t,x,)>y*'^>^"'--|,z = i,2,...iV5. 



So 

.; ' 3' 

where t'(-) = X]i=i -^^«'^*(')- This with (2.7), we have 

i^(t,C)>^/'^^^-£- 



i=l i=l 



□ 



Before stating the generalized Dynamic Programming Principle, let us recall 
the following basic estimate of the solutions to BSDEs which will be used often 
in the sequel (see Theorem 2.3. in [6]): 

Lemma 2.4. Consider the following two BSDEs: 



Y,' = e + I^ [g{sX,Zl) + ^l]ds- 1^ ZldWs, 
Yt' = e + J^gis, ZD + ^'^ds - ZldW,, 



where ^^ f ^ G L'^{Vt, Jy, P] BJ^), ^ M{t, T; i?"^), and ^ : x [0, T]xR"'x 

j^mxd _^ j^m gatisfies: ^{y,z) e i?™ x i?™^'^, g{-,y,z) is a J't-adapted process 
valued in and 



/ \gi-,0,0)\dseL\n,:FT,P;Rn, 
Jo 



\g{t, y, z) - g{t, y\ z')\ < C^dy - y'\ + \z - z'\). 
Then the difference between the solutions to BSDE (a) and (b) satisfies: 



where = 16(1 + 

Now let's consider the so-called backward semigroup (see [6]): V(t, x) G [0, T] x 
M,0 < 5 <T -t,r] e L^{n, Tt+s, P; R), we set 

Glf^sM ■■=yu 

where {Ygi Zs)t<s<t+5 is the unique solution to the following BSDE: 

-dY, = f{s, XI'-'--, Y,, Z„ Vs) - ZsdWs, se[t,t + S], 
Yt+s = V- 



So obviously, 

The follows is the generalized Dynamic Programming Principle (DPP in short): 
Theorem 2.5. y{t,x) G [0,r] x M,\/6 G [0,T-t], we have 

Proof: We will only prove the first equality. By the definition of u{t,x), we 
have 



u{t, x) = essinf„(.)eiy^ j,G*'i^'"-[<l>(X;^^'''-)] 



t,x:v. 



= essinf„(.)ew,,TG't;^+5[Ff+/'^'+' 
So by Lemma 2.3. and the comparison theorem of BSDEs, we get 

u{t, x) > essiiii^^.^^u.^^^sGl'^t+sHt + ^i+T')]- 

On the other hand, for any e > 0, there exists an admissible control v{-) G 
Ut+s,T, such that. 
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Also by the comparison theorem of BSDEs and Lemma 2.4., we have 



u{t,x) = essinU^.^^u.^rGt^t+sl^t+s 

<essinf.(.),^^,^^,G|--[F;;;'^'-"^p 

< essinft,(.)£2^j^^^ 



Since e is arbitrary, (2.8) holds true. 



□ 



In Lemma 2.2., we know that u{t,x) is uniformly continuous in x, uniformly 
in t. Now with the DPP, we can also get that u{t, x) is continuous in t. 

Proposition 2.6. The value function u{t,x) is continuous in t, t G [0,T]. 

Proof: V(t, x) G [0, T]x M,6 e [0,T -t], by the DPP, we have: Ve > 0, there 

It 



exists an admissible control v{-) ElAlrp, such that 



G:;SKt + <5,x;;T)] > n{t,x) > + 5,^:;T)] - ^- (2-9) 

So 

u(t, x) - u{t + S,x)< G\'^,^sHt + ^> ■)] - u{t + S,x) = 1} + /|, (2.10) 
where 

II = IM-)) = G;S[«(t + S, x)] - u{t + 6,x). 
Now let us evaluate and /|. Still by Lemma 2.4., we have 

141 < [CoE\u{t + 6, X*;f ■) - u{t + 6, x)|2]i (2.11) 
We can use the similar method as in (3.6) to get that 

72/ -vt,x;v. 



E[ sup c/'(X*;X,x)] ^ 0, when 6^0. 



Thus for all £o > 0, 



lim sup P{d {X^'^'^'.x) > £q} = 0. 



By the continuity of u w.r.t x, we have 



lim sup sup P{\u{s, Xl'_^f') — u{s, x)\'^ > Eq} = 0. 
^^'^ veulj. se[t,t+s] 
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Recall that u{t, x) is bounded, so 



lim sup sup E\u{s, X^^f') — u{s,x)\ = 0. 

veul j. se[t,t+s\ 



Through (2.11), we know that 



For J|, we have 



limjsup |/](^;(.))|] = 0. 



/| = E[u{t + 5,x) + jl^^ f{s, X'f-^^-X'"'"-,Zl^"'''-,Vs)ds - J^"-^ Z'f^'^-dWs] - u{t + 8. 
From the assumptions (Al) and (A2), 

where /3i is a constant defined in Lemma 2.2. Note (2.6) in Lemma 2.2., we have 

Wsup |/|(t;(.))|] = 0. 

From (2.10), we can conclude that 

limsup[M(i, x) - u{t + 5, x)] < 0. (2.12) 

<5-i-0 

Consider the right inequality of (2.9), we have 

u(t, x) - u{t + 5,x) > G'*^^|'^[-u(t + 6, Xl'^^"')] - u(t + 6,x) - 6 = l] + ij ~ e. 
Thus 



X] 



liminf['u(t,a:) — ii(t + 5, x)] > liminf[— sup sup \l'j{v{-))\] — e. 

So for any e > 0, 

That is 

This with (2.12), we get that lim5^o['^(^? ~ '^^(^ + x)] = 0. 



liminf [ti(i, x) — u{t + 5, x)] > —e. 

<5-i-0 



liminf [^(t, x) — u{t + 5, x)] > 0. 



□ 



Remark 2.7. We can conclude from this proposition and Lemma 2.2. that 
u{t,x) is continuous in {t,x) G [0,T] x M. 
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3 The viscosity solution to the generahzed Hamilton- 
Jacobi-Bellman equation on Rimeannian man- 
ifolds 

As it is well known to all, the value function u{t, x) is usually a viscosity solution 
to some Hamilton- Jacobi-Bellman(H-J-B in short) equation. Our generalized H- 
J-B equation is: 

r dtU{t,x) + mfy(,u{{VoVoU){t,x) + ^ Ylt=li'^lVaVaU){t, x) + f{t,X,U, {VaVaU}'^^^,v)} = 0, 

\ u{T,x) = 

(3.1) 

where v = {vo,vi, ...,Vd) G U and we denote by {faV^M}a=i = {viViu, ...,VdVdu) 
an element in R^^'^. This is a fully nonlinear second order parabolic PDEs on 
Riemannian manifolds. 

The theory of viscosity solutions to PDEs in Euclidean space was introduced 
by M. G. Crandall and P. L. Lions in the 1980's (see [2]). Until recently, D. 
Azagra, J. Ferrera and B. Sanz [1] gave a work about Dirichlet problem on a 
complete Riemannian manifold with some restrictions on curvature. X. Zhu [7] 
studied parabolic PDEs on Riemannian manifolds. 

Definition 3.1. We say u G C([0,T] x M) is a viscosity supersolution 
(subsolution) of (3.1), if u(r, z) > ^{x) (< <l>(x)), and for all (/? G C^'^{[0,T]x M), 
at each minimum (maximum) point {t,x) of u — (p and u{t,x) = (fi{t,x), the 
following inequality holds: 

1 

dt^{t,x) + mfUvoVop){t,x)+-y^ivlVaVaip){t,x)+fit,x,u,{v^Vo^^^^^ < 0(> 0). 

a=l 

u(t, x) is said to be a viscosity solution of (3.1) if it is both a viscosity supersolution 
and a subsoultion. 

We have proved that u{t,x) is continuous in {t,x) G [0,T] x M. So we are 
ready to present that u(t, x) is a viscosity solution of (3.1). 

Theorem 3.2. Under the assumptions (Al) and (A2), the value function 
u(t,x) is a viscosity solution to H-J-B equation (3.1). 

To prove this theorem, we need the following three lemmas. We set 

F{s,x,y,z,v) = dtip{s,x) + {voVoip){s, x) + ^T.'i=iivlVaVa(p)is,x) 

+f{s, X,y + ip{s, X),Z + {VaVa(p}i=i, v), 

and consider the a BSDE defined on [t, t + 6]: 

[ = 0, ^'-'^ 
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Then let us consider following first lemma: 
Lemma 3.3. Vs G [t, t + 5], we have 

Proof: Recall that G*^^^'_^g[(p{t + S,Xl'_^f')] is defined through the solution to 
the following BSDE: 

-dr- = f{s,xl'--'^-,Y--,z^s-,Vs) - z--dWs,se [t,t + d], 

That is 

G'sMt + 6, xi':n] = y:-,s e[t,t+6]. 

So what we need to do is proving that 1^/'*'' + f{s, X*'^''''), s G [t, t + 5] is also a 
solution to (3.3). 

Applying Ito's formula to Y}'"- + ip{s, Xl'^'^-): 

-d{Y}-'^- + ^{s,Xl'^-'^'-)) 
= F{s, X*'"'^-, y/'^ Vs)ds - Zl'^'dWs 

-[9^(^(5, X*'-^-) + {v,V,ip){s,xr'^'-) + \Yl=MVJ^aV){s,Xr'^-)]ds 

-{{v^^M{s,xi^--^^-)]i^,dWs 

= f{s, X^'^-, Y}-'^- + (^(s, Xr'^-),Zl^^' + {(t;.K^)(s, 
-{Zl'^ + {{v^^.^){s,Xl'^-'^-)}i^,)dWs. 

Moreover, 

So y^^'*"' + X*''^'''-), s G [t, t + S\ is in fact a solution to (3.3). By the uniqueness 
of the solution to (3.2), we've finished the proof. 



□ 



Consider the following BSDE which is easier than (3.2): 



(3.4) 



The following lemma shows that, when S is small enough, the difference between 
BSDE(3.2) and (3.4) ir/'"' - y/'"-| can be ignored. 

Lemma 3.4. We have the following estimate: 



Y,'-'--Y,''-\<C5p,{6), (3.5) 
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where, Pi{S) i 0, when 5^0, and pi(-) does not depend on the control f(-) G 

^t,t+s- 

Proof: If we set 

r]^ := sup d{X'f'^-,x). 

se[t,t+5] 

With the similar method as in (3.6), We have 

E[r]^] i 0, when 610. (3.6) 
We can use the estimate in Lemma 2.4. to BSDE(3.2) and (3.4) with = 

g{s,y,z) = F{s,Xl''''''-,y,z,Vs), 

From the definition of the function F, we can see that g{s, y, z) satisfies Lipschitz 
conditions w.r.t. (y, z). And there exists a constant C and a function p(-) with 

p{5) i 0, when 6 iO 

which do not depend on v{-), such that, 

\^i\<cp{d{xr^^-,x)), 

where, when e J, 0, p{e) — )■ 0. 

According Lemma 2.4., we have 

E / -r/;^f -Z^'^f ]ds < / p^{d{X'f'''-,x))ds<C5Ep^{r]^). 

Jt Jt 

(3.7) 

On the other hand, since y/'''- and rr- are both deterministic when v{-) G ^^5, 
apply Ito's formula to Y}'""- — Y^'^- on [t, t + 5], we have 

\yl'''--Y^'"-\ = \E{Yl^--Y^^-)\ 

< E |F(s, Xl'--^--, Y}-^--,Zl-'^-,Vs) - F(s, X, ^2;-, Z^^-, t;,)|rf5 

< S jl^\K\Y}-^^- - y/'^-| + - + C7p(rf(X*'"'-, a;))]ds 

< c6Ep{r]') + C(5^E//+'[|y,i-- - + \zi'-- - zf'--\ys}-2. 

This with (3.7), we get 

l^^i;.. _ ^^2;..| ^ + {Ep'ir^')}-^]. 

Because of the compactness of M, there exists a constant C, such that, r/'' < 
C,V5 > 0. Thus 

^p2(r]^) < 00. 
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This, together with (3.6) we have that (3.5) holds true. 



□ 



2:v. 



The following lemma tells us how to compute inf^j-.^g^*^^^ ' 
Lemma 3.5. We have 



inf = Yoit), 

where Yo(t) is the solution to the following ODE: 

-Yo{s) = Fo{s, X, Yo{s), 0),se[t,t + S], 
Yo{t + S)=0, 

and the function Fo is defined as: 

Fo{t, X, y, z) := inf F{t, x, y, z, v). 

Proof: Consider the following BSDE: 

-dY^^ = Fo{s, X, ZO)ds - Z^JWs, se[t,t + 5], 
Ytls = 0. 



(3.8) 



(3.9) 



Note that Fq is a deterministic function of {t,x,y,z). So the solution to (3.9) is 
just: 

(y,°,zO) = (yo(s),o),sG[t,t + <5], 

that is to say equation (3.8) and BSDE (3.9) are the same one. 
By the definition of Fq, we know 

Fo{s,x,y,z) < F{s,x,y,z,Vs), Vv(-) eUl^^^.s G [t,t + 5]. 

Through the comparison theorem of the solutions to BSDE (3.4) and (3.9), ^v{-) G 

So 

Y,{t) = Y,'< inf Y^-'-. 

On the other hand, if we denote by the set of all admissible controls in 

[t, t + 5] which are deterministic processes. Then we can show that 

Yl> > inf y/'". 
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That is because, Vf (■) G l^tt^s, (Xs '^', s G [t, t + S]) is the solution to the following 
ODE: 

-Y^'^is) = F{s,x,Y^'^is),0,Vs),se [t,t + S], 
y^'^-{t + 6) = 0. 

According to the definition of F, for all e > 0, there exists {vs{s), s G [t, t + (5]) G 
U^i._^_g, such that, 

Fo{s,x,y,z) > F{s,x,y,z,Vs{e)) - |>s G [t,t + 6]. 



That yields 

Since e is arbitrary, we have 
And consequently 



Yl> > inf Ft''" 



i^ol^) = Yl> > inf y/'" > inf r/'"' 



□ 



After the above preparation, we can show the proof of Theorem 3.2. 

The proof of Theorem 3.2. For all tp G C^''^{[0,T x M]), suppose that 
(t, x) is a minimum(resp., maximum) point of m — and u{t, x) — Lp{t, x) = 0. By 
DPP(2.8), we have 

cp{t, x) = u{t, x) = inf^ G'^^i^.Ht + 5, X*;T-)]. 

Since 

this with the comparison theorem of the solutions to BSDEs, 

,K {G;;^-S[^(^ + ^'^m-)]-¥'(^,^)}<0 (resp., >0). 



Through Lemma 3.3., we have 



inf y/'''- < (resp., > 0). 

So by (3.5), 

inf Y^'"- < C6pi{S) (resp., > -CSpi{5)). 



T 
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According Lemma 3.5., it yields 

Yoit) < C5p^{5) (resp., > -C5p^{5)). 

So 

Yo{t) = f^'^'Fo{s,x,Yo{s),0)ds 

= 6Fo{t + 6,x,Yo{t + 5),0) + o{6) 

= 6Fo{t + 6,x,0,0) + o{6) 

< C6pi{6) (resp., > -C5pi{6)). 

Divided by 6 and let 6^0, we have 

Fo(t,x,0,0) = inf F(t,x,0,0,w) < (resp., > 0). 

That is to say 

dt(p{t, X) + M^^u{{VoVo(p){t, X) + 1 T.t=MVaVa(p){t, X) + f{t, X, M, {VaVaip}i=i,v)} < 0, 

(resp,. > 0). 

And obviously, u{T,x) = $(a:). So u{t,x) is a viscosity solution to PDE (3.1). 

Now let's deal with the uniqueness conclusion. We assume that for all x, y G 
M s.t. d{x,y) < mm{iM{x),iM{y)}, t G [0,T], 

{HI) \\L,yVo{t,x) - Vo{t,y)\\ < fid{x,y), 
{H2) L^yV^it, x) = Va{t, y),a = 1,2, d, 

where yU is a positive constant. 
Consider a generalized case: 

( Ut + My^u H{t,x,u,du,d'^u,v) = in (0,T)xM, , . 

\ u{0,x) = ij{x),xe M, ^ ^ ^ 

where, du,d'^u mean dxu{t,x) and dlu{t,x). 
Set 

x:={{t,x,r,C,A,v):te[0,T],xeM,reR,CeTM:,AeC^,{TMx),veU}, 

where TM* stands for the cotangent space of M at a point x, TMx stands for the 
tangent space at x and CKTM^) denotes the symmetric bilinear forms on TM^. 

From [7], we have the following comparison theorem of viscosity solutions to 
PDE (3.10): 

Theorem 3.6. Let M be a compact Riemannian manifold (without bound- 
ary) , and iif : X — ^ -R be continuous, proper for each fixed {t, v) G (0, T) x [/ and 
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satisfy: there exists a function u : [0, +00] — [0, +00] with aj(0+) = and such 
that 

sup[if(t, y, r, Q;exp~'^(x), Q, v)—H{t, x, r, —aexp^^{y), P, v)] < u{a(f{x, y)+d{x, y)), 

(3.11) 

for all fixed t G (0,r) and for all x,y e M,r e R, P e T2,,(M)^,Q e T2,s{M)y 
with 

-(^ + ll^all) ( Q ? ) ^ ( -Q ) - + ' ^^-^2) 

where Aa is the second derivative of the function Lpa{x,y) = ^(P{x,y){a > 0) at 
the point {x, y) e M x M, 

1 

2(1 + PJ|) 

and the points x, y are assumed to be close enough to each other so that d{x, y) < 
mm{iM{x),iM{y)}- 

Let u e USC{[0,T) x M) be a subsolution and v G LSC{[0,T) x M) a 
supersolution of (3.10). Then u < v on [0,T) x M. In particular PDEs (3.10) 
has at most one viscosity solution. 

Theorem 3.7. The value function u{t,x) is the unique viscosity solution to 
PDE(3.1). 

Proof: For PDE(3.1), the function H : [0,T] x M x Rx TM* x CliTM^) x 
U ^ Ris: 

H{t,x,r,C,P,v) 

= -f{t,x,r, {C,vMt,x))Li,v) - {C,voVo{t,x)) - \ E vl{PV^{t,x),V^{t,x)). 

a=l 

So for any fixed t e (0,T),r G R, when d{x,y) < \iM, if P G Cl{TM^),Q e 
Ll{TMy) satisfy the following matrix inequality: 

-(^ + ||AJ|)(J 5)^(0 _q)<^- + ^-^- 

where Aa is the second derivative of the function (pa{x,y) = ^d'^{x,y) at the 
point {x,y) e M X M, 

1 

- 2{i + \\Ajy 

Since M is compact, there is a /cq > s.t. the sectional curvature is bounded 
below by —ko on M. So by Remark 4.7 in [1], 

P-Ly,{Q) < ^koad\x,y)I. 
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Then 

sup [H{t,y,r,a exp-^ (x) ,Q,v) - H{t,x,r,-a exp-^ (y) ,P,v)] 
i)ec/,tG(o,T) 

= sup {f{t,x,r,{-aexp-^{y),v^Vait,x))'^^^,v) 

i>G(7,iG(0,T) 

-f{t, y, r, (aexp-^(a:), v^Va{t, v) 

+ 1 E vl[{PV^{t,x),V^{t,x)) - {QV^{t,y),V^{t,y))] 

a=l 

-{aexp-\y),voVo{t,x)) - {aexp-\x),VoVo{t,y))} 

d 

< sup {Kd{x, y) + \kQad^{x, y) J2 K)(t,x) 

+ {Ly^aexpy^{x),voVo{t,x)) - {aexp-^{x),voVo{t,y))} 

< C{ad\x,y) + d{x,y)). 

Since M and U are both compact, through (Al), (HI) and (H2), we get the last 
inequahty. Where C* is a constant positive. By Theorem 3.6. we can get the 
uniqueness result of the viscosity solution to PDE (3.1). 

□ 
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